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AMSTE-TC-M  (70-10p) 

MEMORANDUM  FOR:  Commander,  U.S.  Army  Electronic  Proving  Ground, 
ATTN:  STEEP-MO, 

SUBJECT:  Stress  Loading  Facility  (SLF)  Final  Report 

1.  Subject  report  is  approved. 

2.  Point  of  contact,  this  headquarters,  is  Mr.  Joseph  Knox, 
AMSTE-TC-M,  amstetcm@apg-4.arpa,  AV  298-2170/3677. 

FOR  THE  COMMANDER: 

GROVER  H.  SHELTON 
Chief,  Meth  Imprv 
Directorate  for  Technology 
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FOREWORD 


The  Institute  for  Telecommunications  Sciences  (ITS)  in  Boulder,  Colorado, 
(a  laboratory  that  is  part  of  the  National  Telecommunications  and  Information 
Administration,  U.S.  Department  of  Commerce)  has  performed  the  study  reported 
here.  The  support  was  provided  under  two  Military  Interdepartmental  Purchase 
Requests,  TO  46-85  and  TO  47-85  (which  were  funded  from  TRMS  No.  7-C0-R85-EP0- 
003  and  7-C0-R85-EP0-004)  under  guidance  provided  by  the  US  Army  Electronic 
Proving  Ground.  While  initially,  there  were  two  projects,  it  was  determined 
that  similarities  between  the  Direction  Finding  and  Non-Direction  Finding 
tasks  were  such  that  a  commom  procedure  for  development  of  Measures  of  Per¬ 
formance  could  be  developed  for  both  tasks  and  described  in  the  final  report. 


SECTION  1.  SUMMARY 


1.1  BACKGROUND 

1.1.1  The  US  Army  Electronic  Proving  Ground  (USAEPG)  has  extensive  test  capa¬ 
bilities  known  as  the  Electromagnetic  Environmental  Test  Facility  (EMETF)  that 
are  used  to  determine  the  EMC/EMV  of  the  US  Department  of  Defense  C-E  systems 
and  equipment.  As  increasingly  sophisticated  C-E  systems  and  equipment  are 
being  developed,  these  test  capabilities  need  to  be  upgraded  substantially  to 
ensure  that  sufficient  testing  is  performed  to  assure  satisfactory  operation  of 
the  system  or  equipment  and  that  this  testing  is  performed  as  economically  as 
possible.  The  Stress  Loading  Facility  (SLF)  is  envisioned  as  a  capability  that 
will  respond  to  these  requirements. 

1.1.2  This  report  and  the  attached  NTIA  Report  87-228  (App  C)  were  prepared  to 
develop  a  standard  approach  to  the  problem  of  developing  measures  of  functional 
performance  (MOFP)  for  complex  EWI  systems. 

1.1.3  The  detailed  information  for  this  document  is  contained  in  the  document 
prepared  by  the  National  Telecommunications  and  Information  Administration, 
Institute  for  Telecommunications  Sciences,  Boulder,  Colorado  80303,  entitled 
"Investigations  of  Test  Methodology  for  the  Stress  Loading  Facility"  and  which 
is  attached  as  Appendix  C  to  this  document.  Following  is  a  brief  description 
of  the  document: 

1. 1.3.1  Material  in  Section  1  provides  an  introduction  to  the  SLF  Test  Method¬ 
ology  development  work  undertaken  by  ITS.  Sections  2  and  3  describe  the  test 
capabilities  of  USAEPG' s  existing  EMETF  and  the  SLF  equipment  and  the  concept 
of  use  of  the  SLF  in  the  EMETF. 

1. 1.3.2  Section  4  describes  a  "Structured  Approach  to  Performance  Description" 
and  is  used  to  outline  that  procedure.  Section  5  introduces  the  unclassified 
parameters  of  two  EWI  systems  and  defines  measures  of  functional  performance 
for  them.  Section  6  provides  an  approach  for  test  design  and  the  development 
of  the  required  data  collection,  reduction,  and  analysis  plan.  Section  7 
describes  measurement  methods  for  typical  electronic  surveillance  systems. 

1.1. 3. 3  Section  8  contains  the  conclusion  and  recommendation.  Section  9  pro¬ 
vides  the  references.  Appendix  A  defines  acronyms  and  abbreviations.  Appendix 
B  applies  the  methodology  to  the  development  of  performance  parameters  to  digi¬ 
tal  communications  systems.  Appendix  C  provides  an  expanded  generalized  test 
plan  for  a  non-specific  test  item  using  the  SLF. 

1.2  OBJECTIVE.  This  study  is  directed  to  the  development  of  determining 
measure  of  function  performance  to  be  used  in  testing  with  the  SLF.  There  are 
three  tasks  that  have  been  addressed  in  performing  the  study.  These  tasks  are 
(1)  a  review  of  the  existing  SLF-type  test  capabilities,  (2)  the  development  of 
measures  of  functional  performance  as  the  basis  for  evaluating  the  performance 
of  electronic  surveillance  systems,  and  (3)  the  development  of  a  framework  for 
general  methodology  for  SLF  utilization  incorporating  these  measures  of  func¬ 
tional  performance. 
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1.3  SUMMARY  OF  PROCEDURES.  ITS  reviewed  existing  SLF-like  capabilities 
including  the  EMETF  (USAEPG)  and  the  TEWES  (Naval  Research  Laboratory  [NRL] ) . 

The  procurement  specifications  for  the  Communications  Threat  Simulator  (CTS) 
were  reviewed.  The  CTS  is  being  developed  based  upon  existing  technology  by 
Unisys,  Reston,  Virginia. 

1.3.1  Based  upon  that  review  and  further  analysis  and  a  review  of  the  func¬ 
tions  required  for  the  Communications-Electronics  (C-E)  systems  likely  to  be 
tested,  ITS  defined  those  functions  which  would  be  necessary  to  adequately  test 
such  systems.  The  functions  were  further  defined  such  that  they  could  be 
determined/measured  at  natural  system  boundaries  and/or  interfaces.  ITS  then 
determined  that  the  set  of  system  functions  could  be  mapped  into  one  of  three 
outcomes:  (1)  intended  performance,  (2)  incorrect  performance,  and  (3)  no  per¬ 
formance.  These  outcomes  were  further  characterized  by  the  primary  performance 
parameters  of  speed,  accuracy,  and  dependability.  Secondary  parameters  were 
then  defined  as  the  statistical  function  of  availability  as  determined  from 
multiple  tests  for  the  primary  parameters.  This  procedure  became  the  model  for 
MOFP. 

1.3.2  To  demonstrate  the  technique  of  developing  MOFP,  ITS  developed  the  MOFP 
for  the  QUICKLOOK  and  TEAMPACK  systems  at  an  unclassified  level. 

1.4  SUMMARY  OF  RESULTS.  The  development  of  measures  of  functional  performance 
used  a  structured  approach  to  defining  system  functions  and  selecting  param¬ 
eters  to  describe  the  performance  of  the  system.  The  approach  followed  step- 
by-step  procedures  to  ensure  that  the  selected  set  of  performance  parameters 
was  complete,  efficient,  and  measurable.  The  parameter  development  was 
approached  from  the  point  of  view  of  the  user  which  produces  parameters  that 
are  measures  of  user-perceived  performance  rather  than  measures  of  the  causes 
(of  user-perceived  performance)  within  the  system.  Such  parameters  were  system 
independent  and,  thus,  very  useful  for  specifying  the  performance  requirements 
for  systems  not  yet  specified  or  designed  and  for  comparing  performance  of 
systems. 

1.5  ANALYSIS.  This  process  led  to  nine  primary  parameters  and  two  secondary 
parameters  that  are  defined  as  the  recommended  measures  of  functional  perform¬ 
ance  for  these  EWI  systems.  These  parameters  would  be  applicable  to  any  elec¬ 
tronic  surveillance  system  for  which  the  primary  functions  are  signal  detection, 
signal  characterization,  and  emitter  identification  and  location. 

1.6  CONCLUSION.  The  conclusion  was  developed  in  the  attached  document  in 
detail  and  is  briefly  stated  below: 

The  structured  approach  to  the  development  of  measures  of  functional 
performance  using  functions  and  parameters  that  are  user-oriented  and  system 
independent  offers  wide  oppoitunity  for  specifying  desired  system  performance 
in  terms  that  are  meaningful  to  users  and  for  comparing  system  performance 
results  on  a  common  basis. 

1.7  RECOMMENDATION.  Further  study  is  required  to  understand  the  relationships 
between  overall  SLF  test  frequency  capabilities,  physical  size  required  for  the 
enclosure,  and  methods  for  coupling  rf  energy  at  all  test  frequencies  and  eval¬ 
uate  the  impact  of  these  factors  on  continued  SLF  development. 
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SECTION  2.  DETAILS  OF  INVESTIGATION 


Details  of  the  investigation  are  contained  in  the  NTIA  Report  87-228, 
Appendix  C  of  this  document. 
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DEPARTMENT  OF  THE  ARMY  Mr.  Miller/brt/AUTOYON 
HEADQUARTERS.  U.!  ARMY  TEST  AND  EVALUATION  COMM  AND  283- 567? 
ABERDEEN  PRO^NG  GROUND.  MARYLAND  210C5 


NfcPLY  TO 

attcmtio*  or 


AMSTE-AD-M 


SUBJECT: 


HDTE  Methodology 
for  Using  SLF  in 
7-CO-R85-EPO-OQ3 


2  1  SEP  '994 

Improvement  Program  Directive,  Techniques 
Testing  Direction  Finding  Systems,  TRMS  No. 


Commander 

US  Army  Electronic  Proving  Ground 

ATTN:  STEEP-TM-TO 

Fort  Huachuca,  AZ  85613 


1 


Reference  TECOM  Regulation  70-12,  dated  1  June  1973. 


2.  This  letter  and  attached  STE  Forms  1188  and  1189  (Enclosure  1) 
constitute  a  directive  for  the  subject  investigation  under  the  TECOM 
Methodology  Improvement  Program  1 V665702D625 . 

f 

3.  The  MIP  at  Enclosure  2  is  the  basis  for  headquarters  approval  of 
the  subject  investigation. 

^  .  Special  Instructions: 

a.  All  reporting  will  be  in  consonance  with  paragraph  9  of  the 
reference.  The  final  report  will  be  submitted  to  this  headquarters, 
ATTN:  AMSTE-AD-M,  in  consonance  with  Test  Event  570/580.  Each  project 
shall  be  completed  in  FY85  as  reflected  in  the  scheduling  in  attached 
STE  Forms  1188  and  1189. 

b.  Recommendations  for  new  TOPs  or  revisions  to  existing  TOPs  will 
be  included  as  part  of  the  recommendation  section  of  the  final  report. 
Final  decision  on  the  scope  of  the  TOP  effort  will  be  made  by  this 
headquarters  as  part  of  the  report  approval  process. 

c.  The  addressee  will  determine  whether  any  classified  information 
is  involved,  and. will  assure  that  proper  security  measures  are  taken 
when  appropriate.  The  OPSEC  guidance  will  be  strictly  followed  during 
this  investigation. 

d.  Prior  to  test  execution,  the  test  activity  will  verify  that  no 
safety  or  potential  health  hazards  to  humans  participating  in  testing 
exist.  If  safety  or  health  hazards  do  exist,  the  test  activity  will 
provide  a  saf ety/ heal th  hazards  assessment  statement  to  this  office 
prior  to  test  initiation. 


Environmental  documentation  for  support  tests  or  special 
responsibility  of  the  test  activity  and  will  be 
to  initiation  of  the  investigation/study. 


studies  is  the 
accomplished  prior 


AMSTE-AD-M  2  1  SEP  1934 

SUBJECT:  ROTE  Methodology  Improvement  Program  Directive,  Techniques 

for  Using  SLF  in  Testing  Direction  Finding  Systems,  TRMS  No. 
7-CO-R85-EPO-003 

f.  Upon  receipt  of  this  directive,  test  milestone  schedules  as 

established  in  TRMS  Ii  data  base  will  be  reviewed  in  light  of  other 
known  workload  and  projected  available  resources.  If  rescheduling  is 
necessary,  a  letter  citing  parti-eulars ,  together  with  recommendations, 
will  be  forwarded  to  Commander,  US  Army  Test  and  Evaluation  Command, 
ATTN:  AMSTE-AD-M,  with  an  information  copy  to  AMSTE-TO-O,  within  15 

calendar  days. 

g.  The  HQ,  TECOM  point  of  contact  is  Mr.  Larry  W.  Miller, 
AMSTE-AD-M,  AUTOVON  283-2170/2375. 

h.  FY85  RDTE  funds  in  the  amount  of  $100,000  have  been  authorized 
for  this  investigation,  DARC0M  Form  1006  will  be  forwarded  by  the 
Comptroller. 


FOR  THE  COMMANDER: 


2  Enel 
as 


GROVER  H.  SHELTON 
C,  Meth  Imprv  Div 
Analysis  Directorate 


January  198- 


METHODOLOGY  INVESTIGATION  PROPOSAL 

1.  TITLE.  Techniques  for  Using  an  SLF  in  Testing  Direction  Finding  Systems. 

2.  CATEGORY .  VISTA,  Sensors. 

3.  INSTALLATION.  US  Army  Electronic  Proving  Ground.  Fort  Huachuca.  Arizona 
85613. 

4.  PRINCIPAL  INVESTIGATOR.  R.  Grinnell,  Modernization  Planning  Office, 
STEEP-MS,  AUTOVON  879-7651/7622,  FTS  769-7651/7622. 

5.  PROBLEM.  Available  draft  information  and  briefings  on  the  planned  elec¬ 
tromagnetic  Stress  Loading  Facility  (SLF)  indicate  that  there  may  be  peculiar 
problems  with  testing  Direction  Finding  (DF)  Systems  totally  in  the  SLF  closed 
loop  type  arrangement.  Detailed  methodology  for  conducting  an  adequate,  valid 
test  program  on  DF  systems,  using  the  SLF  in  conjunction  with  other  test 
facilities,  has  not  been  fully  developed. 

6.  BACKGROUND.  The  proposed  SLF  is  an  integrated  testing  system  and  facility 
designed  to  achieve  an  unprecedented  electromagnetic'  threat  test  environment 
while  simultaneously  monitoring,  key  performance  parameters.  The  SLF  concept 
includes  the  use  of  extensive  software  to:  generate  test  scenarios,  control 
all  aspects  of  real-time  operation,  and  expedite  the  reduction  and  analysis  of 
the  recorded  test  data.  The  SLF  concept  is  applicable  to  development  testing 
of  USA  DF  systems  such  as  Improved  TRAILBLAZER,  TEAMPACK,  and  OUICK  FIX 
ALQ-151.  The  SLF  is  intended  to  provide  the  tester  with  the  ability  to 
accurately  replicate  tests  or  portions  of  a  test  by  maintaining  positive 
control  over  the  test  process.  A  drastic  savings  in  test  time  will  result 
from:  the  expediting  of  test  scenario  generation,  faster  testing,  the  auto¬ 
mation  of  test  control  and  data  reduction,  and  the  need  for  less  retesting. 

The  primary  use  of  the  SLF  will  be  for  the  conduct  of  government  development 
tests.  However,  it  will  also  be  capable  of  supporting  contractor  design 
testing.  It  is  vitally  important  that  this  capability  be  supported  by/based 
on  valid  methodology  that  is  practical  to  implement. 

7 .  GOAL.  To  develop  detailed  application  methodology  required  to  conduct 
functional  performance  testing  of  complex  DF  systems,  using  the  SLF  together 
with  related  test  capabilities;  and  to  recommend  any  technical  or  operational 
improvements  to  the  SLF  that  surface  during  preparation  of  detailed  test 
methodology. 

8.  DESCRIPTION  OF  INVESTIGATION. 


a.  This  investigation  will  develop  specific  methodology  required  to  sup¬ 
port  functional  performance  testing  of  RF  VISTA  DF  systems  using  the  proposed 
SLF  togecher  with  related  computer  simulation,  bench  testing  and  controlled 
field  tests  to  complenent/validate  the  SLF  testing.  Detailed  planning  for 
testing  an  actual  complex  RF  VISTA  DF  system  would  be  accomplished  to  include 
a  valid  Detailed  Test  Plan  for  the  complete  functional  performance  test  using 
the  SLF  in  conjunction  with  other  related  test  capabilities. 


b.  USAEPG  personnel  will: 


testing 


(1) 

of  DF 


Review  the  SLF  capabilities  as  they  relate  specifically  to  the 
type  systems |  especially  the  techniques  for  RF  coupling  tu  the 


System  Under  Test  (SUT). 


(2)  Identify  and  coordinate  with  all  appropriate  agencies  and 
individuals  and  research  appropriate  literature.  Including  the  Ouest  Report 
("EWI  DT  Test  Methodology'*,  15  February  1980)  to  determine  the  generic  and 
specific  measures  of  functional  performance,  as  available,  for  a  candidate  RF 
VISTA  DF  type  system,  such  as  the  Improved  TRAILBLAZER. 

(3)  Specify  which  measures  of  functional  performance  (MOFP)  for  the 
selected  system  should  be  tested  in  the  SLF,  through  bench  tests,  in  con¬ 
trolled  field  tests,  or  through  computer  simulation  and  show  how  these  test 
modes  relate  to  each  other. 


•  (4)  Develop  and  document  a  Detailed  Test  Plan  (DTP)  for  the  SLF  and 
field  tests  of  the  candidate  system  in  paragraph  b  (2)  above,  discussing  in 
detail  the  relative  roles  of  computer  simulation,  SLF  testing,  bench  testing 
and  controlled  field  testing.  It  is  anticipated  that  the  documents  generated 
may  be  classified  up  to  TOP  SECRET/SI  since  methodology  developed,  specifica¬ 
tions  of  threat,  and  possibly  some  measures  of  functional  performance  may  be 
extremely  sensitive.  The  DTP  should  also  include  any  applicable  DVAL  test 
methodology  that  has  been  documented  up  to  that  time. 


(5)  Develop  and  document  a  planning  checklist  by  both  time  and  event 
for  the  pre-test,  during-test,  and  post-test  events  that  must  take  place  in 
order  to  adequately  prepare  for  and  use  the  SLF  and  related  computer 
simulation  capabilities  for  the  candidate  DF  system  test. 

(6)  Develop  and  document  technical/operational  areas  of  the  SLF  that 
must  be  modified/improved/researched  in  order  to  enhance  the  use  of  the  SLF 
for  testing  of  DF  type  systems. 

c.  Investigation  will  be  completed  as  follows: 


SLF  DF  Test  Capability  Review 
Coordination  +  Literature  Search 
MOFP  Specification 
Develop/Document  Detailed  Test  Plan 
Develop /Document  Planning  Checklist 
Develop/Document  SLF  Improvements 
Report 


SCHEDULE 
FY85  (Otrs) 

1_  2  3.  i 

X 

X  X 

X 

XXX 
X  X 

X  X 

X 
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9.  JUSTIFICATION 


a.  Association  with  Mission.  TECOM  is,  and  will  be,  required  to  test 
most  of  t-he  expanding  number  cf  complex  C^/EWI/SAS  including  RF  VISTA  OF 
systems  under  current  development. 

b.  Present  Capability, Limitations ,  Improvements,  and  Impact  on  Testing 


if  not  Approved.  TECOM' s  current  capability  to  test  the  extremely  complex 
C^/EWI/BAS  including  RF  VISTA  systems  does  not  allow  stressing  such  systems 
sufficiently  to  completely  determine  design  performance.  The  SLF  is  conceived 
to  resolve  this  limitation,  but  must  be  supported  by  adequate  methodology  that 
is  valid  and  practical.  This  investigation  will  enable  development  of  that 
methodology  for  OF  type  systems.  If  the  effort  is  not  accomplished,  TECOM 
faces  a  substantial  risk  of  not  being  able  to  conduct  adequate  tests  of 
complex  RF  VISTA  DF  systems  when  tasked  to  do  so. 

c.  Dollar  Savings.  Direct  dollar  savings  are  not  anticipated  to  result 
Itom  this  investigation. 

d.  Workload.  The  following  DT  II/PIP  programs  will  benefit  from  the 
conduct  of  this  investigation: 

FISCAL  YEAR 


Improved  TRAILBLAZER  AN/TSO-1 14B  X  X 

TEAMPACK  -  AN/MSQ-103A  XXX 

QUICK  FIX  AL0-I5I  (ECM/DF)  XXX 

e.  Association  with  Requirements  Documents.  All  specifications/ROC 
documents  support  test  programs  in  paragraph  9d  above. 

10.  RESOURCES: 

a.  Financial. 


Dollars  (Thousands) 


In-House  Out-of-House 


Personnel  Compensation 
Travel 

Contractual  Support 
Materials  &  Supplies 
Subtotal 

Total 


100.0 


B: 

ft 
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(1)  Personnel  Compensation.  Principal  investigator ,  two  engineers, 
and  support  personnel. 

(2)  Contractual  Support.  Support  will  be  required  for  approximately 
30  percent  of  the  effort. 

c.  Obligation  Plan. 


F0  1 


Obligation  Rate 
(Thousands) 


17  33  34  16 


TOTAL 

100 


d .  In-House  Personnel , 


(1)  Requirements. 


Electronic  Engineer 


FY  85 
MANHOURS 

NUMBER  REQUIRED  AVAILABLE 


(2)  Resolution  of  nonavailable  personnel:  N/A. 


11.  INVESTIGATION  SCHEDULE. 


_ FY  85 _ 
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In-house 

Contract 


Symbols:  -  -  Active  investigation  work  (all  categories) 

...  Contract  monitoring  (in-house  only) 

12.  ASSOCIATION  WITH  TOP  PROGRAM. 

No  TOPs  are  anticipated  to  result  exclusively  from  this  investigation. 
FOR  THE  COMMANDER: 


ROBERT  E.  REINER 

Chief,  Modernization  Planning  Office 
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HEADQUARTERS  U  S  ARMY  TEST  AND  EVALUATION  COMMAND  283-3677 
ABERDEEN  PROVING  GROUND  MARYLAND  2'0CS 
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SUBJECT:  RDTE  Methodology  Improvement  Program  Directive,  Development 

of  SLF  Test  Techniques  (Non-DF),  TRMS  No.  7-CO-R85-EPO-CO- 


« 


Commander 

US  Army  Electronic  Proving  Ground 

ATTN:  STEEP- TM-TO 

Fort  Huachuca,  AZ  85613 


1.  Reference  TECOM  Regulation  70-12,  dated  1  June  1973. 

2.  This  letter  and  attached  STE  Forms  1188  and  1189  (Enclosure  1) 
constitute  a  directive  for  the  subject  investigation  under  the  TECOM 
Methodology  Improvement  Program  1 W665702D625 . 

3.  The  MTP  at  Enclosure  2  is  the  basis  for  headquarters  approval  of 
the  subject  investigation. 

A.  Special  Instructions: 

a.  All  reporting  will  be  in  consonance  with  paragraph  9  of  the 
reference.  The  final  report  will  be  submitted  to  this  headquarters, 
ATTN:  AMSTE-AD-M,  in  consonance  with  Test  Event  570/580.  Each  project 
shall  be  completed  in  FY85  as  reflected  in  the  scheduling  in  attached 
STE  Forms  1188  and  1189- 

b.  Recommendations  for  new  TOPs  or  revisions  to  existing  TOPs  will 
be  included  as  part  of  the  recommendation  section  of  the  final  report. 
Final  decision  on  the  scope  of  the  TOP  effort  will  be  made  by  this 
headquarters  as  part  of  the  report  approval  process. 

c.  The  addressee  will  determine  whether  any  classified  information 
is  Involved,  and  will  assure  that  proper  security  measures  are  taken 
when  appropriate.  The  OPSEC  guidance  will  be  strictly  followed  during 
this  investigation. 

d.  Prior  to  test  execution,  the  test  activity  will  verify  that  no 
safety  or  potential  health  hazards  to  humans  participating  in  testing 
exist.  If  safety  or  health  hazards  do  exist,  the  test  activity  will 
provide  a  safety/health  hazards  assessment  statement  to  this  office 
prior  to  test  initiation. 

e.  Environmental  documentation  for  support  tests  or  special 
studies  is  the  responsibility  of  the  test  activity  and  will  be 
accomplished  prior  to  initiation  of  the  investigation/study. 
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AMSTE-AD-M  §EP  3-" 

SUBJECT:  RDTE  Methodology  Improvement  Program  Directive,  Development 

of  SLF  Teat  Techniques  (Non-DF),  TRMS  No.  7-CO-R85-EPO-OOi 

f.  Upon  receipt  of  this  directive,  test  milestone  schedules  as 

established  in  TRMS  II  data  base  will  be  reviewed  in  light  of  other 
known  workload  and  projected  available  resources.  If  rescheduling  is 
necessary,  a  letter  citing  particulars,  together  with  recommendations, 
will  be  forwarded  to  Commander,  US  Army  Test  and  Evaluation  Command, 
ATTN:  AMSTE-AD-M,  with  an  information  copy  to  AMSTE-TO-O,  within  15 

calendar  days. 

g.  The  HQ,  TECOM  point  of  contact  is  Mr.  Larry  W.  Miller, 
AMSTE-AD-M,  AUTOVON  283-2170/2375. 

h.  FY85  RDTE  funds  in  the  amount  of  $95,000  have  been  authorized 
for  this  investigation,  DARCOM  Form  1006  will  be  forwarded  by  the 
Comptroller. 

FOR  THE  COMMANDER: 


2  Enel 


GROVER  H.  SHELTON 
C,  Meth  Imprv  Div 
Analysis  Directorate 
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January  1984 

RDTE  METHODOLOGY  INVESTIGATION  PROPOSAL 

1.  TITLE.  Development  of  SLF  Test  Techniques  (Non-DF). 

2.  CATEGORY.  VISTA  Sensors. 

3.  INSTALLATION.  US  Army  Electronic  Proving  Ground,  Fort  Huachuca,  Arizona 
85613. 

4.  PRINCIPAL  INVESTICATOR.  Mr.  R.  Grinnell,  Modernization  Planning  Office, 
STEEP-MS,  AUTOVON  879-7651/7622,  FTS  769-7651/7622. 

5.  PROBLEM.  Available  draft  information  and  briefings  on  the  planned  elec¬ 
tromagnetic  Stress  Loading  Facility  (SLF)  present  a  capability  design  for 
testing  Command,  Control,  Communications/Electronic  Warfare  and  Intelligence/ 
Battlefield  Automated  Systems  (C^/EWI/BAS)  in  a  closed  loop  environment, 
presently  unavailable  in  a  single  facility.  However,  the  detailed  methodology 
for  conducting  adequate  valid  testing  of  the  functional  performance  of  such 
systems  has  not  been  fully  developed  for  the  SLF. 

6.  BACKGROUND .  The  proposed  SLF  is  an  integrated  testing  system  and  facility 

designed  to  achieve  an  unprecedented,  electromagnetic  threat  test  environment 
while  simultaneously  monitoring  key  performance  parameters.  The  SLF  concept 
includes  the  use  of  extensive  software  to:  generate  test  scenarios,  control 
all  aspects  of  real-time  operation,  and  expedite  the  reduction  and  analysis  of 
the  recorded  test  data.  The  SLF  concept  is  applicable  to  development  testing 
of  USA  intercept/DF/janming  systems  such  as  Improved  TRAILBLAZER,  Improved 
OUICKLOOK,  Improved  GUARDRAIL,  and  TEAMPACK,  as  well  as  less  complex  systems 
such  as  TL0-I7A  and  TRR-27,  The  SLF  will  provide  the  tester  with  the  ability 
to  accurately  replicate  tests  or  portions  of  a  test  by  maintaining  positive 
control  over  the  test  process.  A  drastic  savings  in  test  time  will  result 
from:  the  expediting  of  test  scenario  generation,  faster  testing,  the  automa¬ 

tion  of  test  control  and  data  reduction,  and  the  need  for  less  retesting.  The 
primary  use  of  the  SLF  will  be  for  the  conduct  of  government  development 
tests.  However,  it  will  also  be  capable  of  supporting  contractor  design  test¬ 
ing.  It  is  vitally  important  that  this  capability  be  supportec  by/based  on 
valid  methodology  that  is  practical  to  implement. 

7.  GOAL.  To  develop  detailed  application  methodology  required  to  conduct 
functional  performance  testing  of  complex  non-DF  systems  (to  include  those 
with  integral  voice/data  communication  links)  using  the  SLF  together  with 
related  test  capabilities;  and  to  develop  a  basic  generic  handbook  on  the  use 
of  the  SLF  for  all  applicable  C3/EWI/BAS  testing. 

8.  DESCRIPTION  OF  INVESTIGATION. 

a.  This  investigation  will  develop  specific  nethodology  required  to  sup¬ 
port  functional  performance  testing  of  RF  VISTA  non-DF  systens  including  those 
with  integral  voice/data  links  and  interfaces  into  DC3I  systems,  using  the 
proposed  SLF  together  with  related  computer  simulation,  bench  tests,  and 
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controlled  field  tests  to  complenent/validate  the  SLF  testing.  This  investiga¬ 
tion  will  develop  an  initial  version  (strawman)  of  a  basic  generic  handbook  on 
the  use  of  the  SLF  for  all  applicable  C^/EWI/BAS  testing. 

b.  USAEPG  will: 

(1)  Review  the  SLF  capabilities  as  they  relate  specifically  to  the 
testing  of  non-DF  type  systems,  especially  the  techniques  for  RF  coupling  to 
the  System  Under  Test  (SUT)  for  the  systems  with  Integral  communication  links 
and  the  use  of  the  Communications  Threat  Simulator  simultaneously  with  the 
Radar  Threat  Simulator. 

(2)  Identify  and  coordinate  with  all  appropriate  agencies  and 
individuals  and  research  appropriate  literature,  including  the  Ouest  Report 
(“EWI  DT  Test  Methodology-,  15  February  1980)  to  determine  the  generic  and 
specific  measures  of  functional  performance,  as  available,  for  a  candidate  RF 
VISTA  non-DF  type  system.  This,  preferrably,  would  be  one  with  an  integral 
voice/data  communications  link,  such  as  the  Improved  OUICKLOOK. 

(3)  Specify  which  measures  of  functional  performance  (MOFP)  for  the 
selected  system  should  be  tested  in  the  SLF,  through  bench  tests,  in  con¬ 
trolled  field  tests,  or  through  computer  simulation  and  show  how  these  test 
modes  relate  to  one  another. 

(4)  Develop  and  document  a  Detailed  Test  Plan  (DTP)  for  the  SLF  and 
related  test  capabilities  for  the  candidate  system  in  paragraph  b  (2)  above, 
discussing  in  detail  the  relative  roles  of  computer  simulation,  SLF  testing, 
bench  testing  and  controlled  field  testing.  It  is  anticipated  that  the 
documents  generated  may  be  classified  up  to  TOP  SECRET/SI  since  methodology 
developed,  specifications  of  threat,  and  possibly  some  measures  of  functional 
performance  may  be  extremely  sensitive.  The  DTP  should  also  include  any 
applicable  DVAL  test  methodology  that  has  been  documented  up  to  that  time. 

(5)  Develop  and  document  a  planning  checklist  by  both  event  and  time 
relative  to  the  start  of  testing  for  the  pre-test,  during-test,  and  post-test 
events  that  must  take  place  in  order  to  adequately  prepare  for  and  use  the  SLF 
and  related  computer  simulation  capabilities  for  the  candidate  non-DF  system. 

(6)  Develop  and  document  a  basic  generic  handbook  on  the  use  of  the 
SLF  for  all  applicable  C^/EWI/BAS  testing  to  include  such  areas  as  test 
scenario  generation,  data  base  updating,  Test  Data  Monitoring  System  pro¬ 
gramming  and  use,  statistical  test/analysis  tools,  RF  coupling  techniques, 
etc.  This  would  be  a  basic  version  which  would  be  updated  as  more  informa¬ 
tion/experience  became  available. 

(7)  Develop  and  document  technical/operational  areas  of  the  SLF  that 
must  be  modified/improved/researched  in  order  to  enhance  the  use  of  the  SLF 
for  testing  of  non-DF  type  systems,  especially  those  with  integral  voice/data 
communication  links. 


c.  Investigation  will  be  completed  as  follows: 


SCHEDULE 
FYS5  v  Ctrs ) 


SLF  non-DF  Test  Capability  Review  X 

Coordination  +  Literature  Search  X  X 

MOFP  Specification  X 

Develop /Document  Detailed  Test  Plan  XXX 

Develop/Docunent  Planning  Checklist  X  X 

Develop/Document  Generic  SLF  Handbook  X  X 

Develop/Docunent  SLF  Improvements  X  X 

Report  X 

9.  JUSTIFICATION. 

a.  Association  with  Mission.  TECOM  is,  and  will  be,  required  to  test 
most  of  the  expanding  number  of  complex  C^/EWI/BAS  including  RF  VISTA  non-DF 
systems  under  current  development. 

b.  Present  Capability,  Limitations,  Improvements,  and  Impact  on  Testing 
if  not  Approved.  TECOM 's  current  capability  to  test  the  extremely  cumplex 
C-Vewi/BAS  including  RF  VISTA  systems  and  their  interoperability  with 
related  DC3I  systems  does  not  allow  stressing  such  systems  sufficiently  to 
completely  determine  design  performance.  The  SLF  is  conceived  to  assist  in 
resolving  this  limitation,  but  must  be  supported  by  adequate  methodology  that 
is  valid  and  practical.  This  investigation  will  enable  development  of  that 
methodology  for  non-DF  type  systems.  If  the  effort  is  not  accomplished,  TECOM 
faces  a  substantial  risk  of  not  being  able  to  conduct  adequate  tests  of 
complex  C^/EWI/BAS  systems  when  tasked  to  do  so. 

c.  Dollar  Savings.  Direct  dollar  savings  are  not  anticipated  to  result 
from  this  investigation. 

d.  Workload .  The  following  DT  II/PIP  programs  will  benefit  from  the 
conduct  of  this  investigation: 

FISCAL  YEAR 


Improved  GUARDRAIL  V 
Improved  OUICKLOOK 
Advance  RADAR  Freq.  CM 
Advance  Threat  RF  Warning  Eq . 

Advanced  Threat  -  AN/ALO-136 

Remotely  Monitored  Battlefield  Sensor 
HOME  RUN 

T AC JAM  -  AN/ML034 
TRAFFIC  JAM  -  AN/AL0-17A 

AN/MLO-XX  JAMMER  REPLACEMENT  for  AN/TL0-17A 
ADEWS 
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e.  Association -with  Requirements  Docoments.  All  9pecif ications/ROC 
documents  support  test  programs  In  paragraph  9d  above. 

10.  RESOURCES. 


a.  Financial. 


Dollars  (Thousands) 


In-House  Out-of-House 


Personnel  Compensation  59.0 

Travel  5.0 

Contractual  Support  30.0 

Materials  &  Supplies  1.0 

Equipment  ____ __  ______ 

Subtotal  65.0  30.0 

Total  9570 

b.  Explanation  of  Cost  Catagories. 

(1)  Personnel  Compensation.  Principal  investigator,  two  engineers, 
and  support  personnel. 

(2)  Contractual  Support.  Support  will  be  required  for  approximately 
30  percent  of  the  effort. 


c.  Obligation  Plan. 


Obligation  Rate 
(Thousands) 

d.  In-House  Personnel. 
(1)  Requirements. 


PQ _ 1 


15  32  33  15 


TOTAL 

95 


FT  85 
MANHOURS 

NUMBER  REQUIRED  AVAILABLE 


Electronic  Engineer 


(2)  Resolution  of  nonavailable  personnel:  N/A. 


1.  INVESTIGATION  SCHEDULE: 
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In-house  —  —  R 

Contract  . 

Symbols:  -  -  Active  investigation  work  (all  categories) 

...  Contract  monitoring  (in-house  only) 


12.  ASSOCIATION  WITH  TOP  PRO GRAM:. 

No  TOPS  are  anticipated  co  result  exclusively  from  this  investigation. 
FOR  THE  COMMANDER: 


ROBERT  R.  REINER 

Chief,  Modernization  Planning  Office 


APPENDIX  B.  ACRONYMS  AND  ABBREVIATIONS 


(Note:  More  complete  definitions  for  some  terms  are  found  in  the 
NTIA  Report,  Appendix  C.  (These  are  provided  only  for  understanding  this 
document. ) 


C-E 

CTS 

EL  I  NT 

EMC 

EMETF 

EMV 

EW 

EWI 

FSS 

ITS 

MOFP 

NCTS 

NRL 

QUICKLOOK 

SLF 

SUT 

TEAMPACK 

TEWES 

TIS 

USAEPG 


Communi cati ons-El ectroni cs 

Communications  Threat  Simulator 

ELectronic  INTelligence 

ElectroMagnetic  Compatibility 

ElectroMagnetic  Environmental  Test  Facility 

ElectroMagnetic  Vulnerability 

Electronic  Warfare 

EW/Intel 1 igence 

Functional  System  Simulator 

Institute  of  Telecommunications  Sciences 

Measures  of  Functional  Performance 

Non-Communications  Threat  Simulator 

Naval  Research  Laboratories,  Washington  DC 

Airborn,  Non-Communications,  ELINT  System 

Stress  Loading  Facility 

System  Under  Test 

AN/MSQ-103  Special-Purpose  Receiver  Set 
Tactical  Electronic  Warfare  Environment  Simulator 
Test  Item  Stimulator  (vice  Simulator) 

United  State  Army  Electronic  Proving  Ground 
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APPENDIX  D.  REFERENCES 
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from  U.S.  Army  Test  and  Evaluation  Command,  Aberdeen  Proving  Ground, 
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February  1986. 
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Stress  Loading  Concept  of  Operations  (Available  from  US  Army  Electronic 
Proving  Ground,  Fort  Huachuca,  AZ  85313-7110). 

7.  USAEPG  Publication  (1987),  Advanced  SLF  Test  Techniques  Volume  II,  EMETF 
Stress  Loading  Facility  Handbook  (Available  from  US  Army  Electronic  Proving 
Ground,  Fort  Huachuca,  AZ  85613-7110). 

8.  USAEPG  Publication  (1987),  Advanced  SLF  Test  Techniques  Volume  III, 
Internal  Operating  procedures  (Available  from  US  Army  Electronic  Proving 
Ground,  Fort  Huachuca,  AZ  85613-7110). 


APPENDIX  E.  DISTRIBUTION 


Number 

Addressee  of  Copies 

Commander 

U.S.  Army  Test  &  Evaluation  Command 

ATTN:  AMSTE-TC-M  3 

Aberdeen  Proving  Ground,  MD  21005-5055 

Defense  Technical  Information  Center 

ATTN:  FDAC  2 

Cameron  Station  Alexandria,  VA  22304-6145 

Commander 

U.S.  Army  Electronic  Proving  Ground 

ATTN:  STEEP-TD  1 

STEEP-ET  1 

STEEP-DT  1 

STEEP-MO-M  4 

Fort  Huachuca,  AZ  85613-7110 

Commander 

White  Sands  Missile  Range 

ATTN:  STEWS-Pl-P  (Art  Foster)  1 

White  Sands  Missile  Range,  NM  88002 

Headquarters 

U.S.  Army  Information  Systems  Engineering  Command 

ATTN:  ASB-SET-S  (Nick)  1 

Fort  Huachuca,  AZ  85613-5300 


